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Abstract 

H 

l~H This paper addresses a unified approach towards communication in decentraUzed wireless networks of separate 

O transmitter-receiver pairs. Different transmitters are connected to different receivers through channels with static 

^ and non-frequency selective gains. In general, users are unaware of each other's codebooks and there is no central 

controller to assign the resources in the network to the users. A randomized signaling scheme is introduced in 
^ which each user locally spreads its Gaussian signal along a randomly generated spreading code comprised of a 

sequence of nonzero elements over a certain alphabet. Along with spreading, each transmitter also masks its output 

cn 

independently from transmission to transmission. Using a conditional version of entropy power inequality and a 

O 

key lennma on the differential entropy of mixed Gaussian random vectors, achievable rates are developed for the 
users. Assimiing the channel gains are realization of independent continuous random variables, each user finds the 
optimum parameters in constructing the randomized spreading and masking sequences by maximizing the average 
achievable rate per user. It is seen that as the number of users increases, the achievable Sum Multiplexing Gain of the 
network approaches that of a centralized orthogonal scheme where multiuser interference is completely avoided. An 
interesting observation is that in general the elements of a spreading code are not equiprobable over the underlying 
alphabet. This is in contrast to the customary use of binary PN codes in spread spectrum communications in which 
the code elements may be selected with equal probability over {—1,1}. This particularly happens if the number 
of active users is greater than three. Finally, using the recently developed extremal inequality of Liu-Viswanath, 
we present an optimality result showing that transmission of Gaussian signals via spreading and masking yields 
higher achievable rates than the maximum achievable rate attained by applying masking only. 
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I. Introduction 

An important topic in modem wireless communications is the subject of decentralized networks. By 
definition, a decentralized network of separate transmitter-receiver pairs has no central controller to allocate 
the network resources among the active users. As such, resource allocation must be performed locally 
at each node. In general, users are not already aware of the number of active users and the channel 
gain^ Also, users are not aware of each other's codebooks implying multiuser detection is not possible, 
i.e., users treat each other as noise. Multiuser interference is known to be the main factor limiting the 
achievable rates in such networks particularly in the high Signal-to-Noise Ratio (SNR) or interference 
limited regime. Therefore, all users must follow a distributed signaling scheme such that the destructive 
effect of interference on each user is minimized, while the resources are fairly shared among users. 

Most of distributed schemes reported in the literature rely on either game-theoretic approaches or 
cognitive radios. Cognitive radios [[T|, [|2| have the ability to sense the unoccupied portion of the available 
spectrum and use this information in resource allocation. Although such smart radios avoid the use of 
a central controller, they require sophisticated detection techniques for sensing the spectrum holes and 
dynamic frequency assignment which add to the overall system complexity [|3|-[[5|. 

Distributed strategies based on game theoretic arguments have already attracted a great deal of attention. 
In [[6|, the authors introduce a non-cooperative game theoretic framework to investigate the spectral 
efficiency issue when several users compete over an unlicensed band with no central controller. Reference 
||7J offers a brief overview of game theoretic dynamic spectrum sharing. Although these schemes enable 
us to understand the dynamics of distributed resource allocation, they usually suffer from complexity in 
software and convergence issues as they rely on iterative algorithms. 

Spread spectrum communications is a natural setup to share the same bandwidth by several users. 
This area has attracted tremendous attention by different authors during the past decades in the context of 
centralized uplink/downlink multiuser systems. Appealing characteristics of spread spectrum systems have 
motivated researchers to utilize these schemes in networks without a certain infrastructure, i.e., packet radio 
or ad-hoc networks [j8|. In direct sequence spread spectrum systems, the signal of each user is spread using 
a pseudo-random noise (PN) code. The challenging point is that in a network without a central controller, 
if two users use the same spreading code, they will not be capable of recovering the data at the receiver 
side due to the high amount of interference. Distributed code assignment techniques are developed in 

'Throughout the paper, we assume the channel from each transmitter to each receiver is modeled by a static and non-frequency selective 
gain. 



[|9|, [10|. In using a greedy approximation algorithm and invoking graph theory, a distributed code 



assignment protocol is suggested. Another category of research is devoted to devise distributed schemes 
in the reverse link (uplink) of cellular systems. Distributed power assignments algorithms are proposed 



in 1 11 1, [12|. Reference [13] proposes a distributed scheduling method called the token-bucket on-off 
scenario utilized by autonomous mobile stations where its impact on the overall throughput of the reverse 
link is investigated. Furthermore, decentralized rate assignments in a multi-sector code division multiple 
access wireless network are discussed in [ jl4| . 

Being a standard technique in spread spectrum communications and due to its interference avoidance 
nature, Frequency Hopping is the simplest spectrum sharing method to use in decentralized networks. 
As different users typically have no prior information about the codebooks of the other users, the most 
efficient method is avoiding interference by choosing unused channels. As mentioned earlier, searching 
the spectrum to find spectrum holes is not an easy task due to the dynamic spectrum usage. As such, 
FH is a realization of a transmission scheme without sensing, while avoiding the collisions as much as 
possible. Frequency hopping is one of the standard signaling schemes adopted in ad-hoc networks. In 



short range scenarios, bluetooth systems [15|-[17| are the most popular examples of a wireless personal 
area network or WPAN. Using FH over the unlicensed ISM band, a bluetooth system provides robust 
communication to unpredictable sources of interference. A modification of Frequency Hopping called 
Dynamic Frequency Hopping (DFH), selects the hopping pattern based on interference measurements in 
order to avoid dominant interferers. The performance of a DFH scheme when applied to a cellular system 



is assessed in |18|-[20| 



Distributed rate assignment strategies are recently adopted in the context of medium access control. It 
is well-known pT| that the capacity region of a multiple access channel with n users is a polytope 



with a n! comer points. Let each comer point of £H be an n-tuple whose elements are among the numbers 



Ri, ■ ■ ■ , Rl-1 and Rl. With no cooperation among the users, the authors in |22| propose that each user 
selects a codebook of rate Ri with probability pi E (0, 1) for 1 < / < L. Assuming the receiver is aware of 
the rate selection of all users, the average sum rate of the network is _R = L}Ph ' ' 'Pui^h + 

h i?iJl(i?,^,...,R,,j6« where ^r^j^<,^ is 1 if {Ri,,--- ,Rin) e 5^ and otherwise. Finally, the 

numbers pi,--- ,Pl-i and pi are derived to maximize R. Major differences of this scenario with a 
decentralized wireless network are 

1 ) The capacity region of a multiuser interference channel is unknown. 



2) In case transmitters have different choices to select the transmission rate, a certain receiver is not 
guaranteed to be aware of the transmission rate of interferers. 

3) Any user is already unaware of the gains of channels connecting the interferers' transmitters to its 
receiver. Also, any user is never capable of finding the amount of interference it imposes on other users. 

It is well-known that in the low SNR regime continuous transmission of i.i.d. Gaussian signals is 
optimal. However, as SNR increases, this scheme turns out to be quite inefficient. For instance, the 
achievable rate of each user eventually saturates, i.e., the achieved Sum Multiplexing Gairj^ (SMG) is 



equal to zero. Using the results in [23 1, it is easy to see that by using a masking strategy where each user 
quits transmitting its Gaussian signals independently from transmission to transmission, a nonzero SMG 
of (l — ^ is attained in a decentralized network of n users. This is an interesting result in the sense 
that if the number of active users tends to infinity, the achieved SMG settles on ^ > 0. 
In the present paper, we answer the following questions: 

Question i- Is it possible to achieve an SMG larger than ^ as the number of users becomes large? 

We propose a distributed signaling scheme where each user spread its Gaussian signal along a spreading 
code consisting of i.i.d. elements selected according a globally known Probability Mass Function (PMF) 
over a finite alphabet Thereafter, the resulting sequence is punctured independently from symbol 
to symbol with a certain probability representing the masking operation. For example, assuming = 
{ — 1,1}, let the generated spreading code have length 10 and be given by 

(1,1,-1,-1,-1,1,-1,1,1,-1). (1) 

Also, an i.i.d. sequence of I's (representing TRANSMIT) and O's (representing MASK) with length 10 is 
generated as 

(0,1,1,0,0,1,1,1,0,0). (2) 

Finally, denoting the Gaussian signal to be transmitted by x, the sequence 

(0,a;, —x, 0,0, X, —a;, 33,0,0). (3) 

is transmitted in 10 consecutive transmission slots called a transmission frame. This process is repeated 
independently from transmission frame to transmission frame. We notice that since different users are not 

^The Sum Multiplexing Gain represents the scaling of the sum rate in terms of log SNR as SNR tends to infinity. 
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aware of each other's signals and the spreading/masking sequences, the noise plus interference vector at 
the receive side of any user is a mixed Gaussian random vector. We assume the knowledge of interference 
Probability Density Function (PDF) at the receiver side of each user. We are able to see that using the 
proposed randomized spreading scheme, the number of active users and the gains of channels conveying 
the interferers' signals can be easily found by inspecting the interference PDF and solving a set of linear 
equation. 

Assuming all users are frame -synchronous, we derive achievable rates for the users in three steps: 

Step 1- Using Singular Value Decomposition (SVD) of the signal space at the receiver side any user, 
the interference vector is mapped in the signal space and the complement space|^ of the signal space. 

Step 2- A conditional version of entropy power inequality is used to derive a lower bound on the mutual 
information between the input and output of each user along any transmission frame. The conditioning is 
made over the contents of the interference vector mapped in the complement space of the signal space. 

Step 3- The resulting lower bound in the previous step highly depends on the differential entropy of 
mixed Gaussian random vectors. Since there is no closed formula on the differential entropy of a mixed 
Gaussian vector, a key Lemma is used to find computable bounds on this differential entropy. This leads 
us to the final formulation of the achievable rate. 

In a decentralized network of n users, we are able to show that by regulating the length of the 
transmission frame and the probabilistic structure of the spreading/masking sequences, the resulting lower 
bound scales like SMG(n) log SNR where lim„_>.oo SMG(r?,) = 1. This is exactly the SMG of a centralized 
orthogonal resource allocation scheme where multiuser interference is completely avoided. 

Our focus is not particularly on the high SNR regime. In fact, the length of the transmission frame 
and the probabilistic parameters of the spreading/masking codes are sensitive to the choice of SNR. Our 
proposed achievable rate for any user in general depends on the gains of the channels conveying the 
interference. As mentioned earlier, each user is capable of finding the channel gains, however, if each 
user attempts to maximize its achievable rate over the length of the transmission frame and other code 
parameters, different users come up with different choices which results in inconsistency. To circumvent 
this difficulty, assuming the channel gains are realizations of i.i.d. continuous random variables, each user 
selects the code parameters such that the average of achievable rate per user over different realizations 
of the channel gains is maximized. This leads to a consistent and distributed method to design the best 

^In any Euclidean space S and a subspace of (f, the complement space of ^i^ is the set of elements in S that are perpendicular 
to any element in 
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randomization algorithm in constructing the spreading/masking sequences. 

An interesting observation is that even in the simplest scenario where the underlying alphabet is { — 1, 1} 
and no masking is appliecj^ the elements of the spreading codes are not equiprobable over {—1,1}. For 
example, our simulation results show that in a network of n = 4 users at SNR = 60dB, the elements of 
the spreading code must be selected to be 1 with a probability of 0.01 and —1 with a probability of 0.91 
or vice versa. 

Question 2- What is the highest achievable rate under the masking protocol? Can one do better than 
masking? 

One may raise the question if masking the transmitted signals independently from transmission slot 
to transmission slot is by itself sufficient, i.e., by selecting the PDF of the transmitted signals properly 
(probably non-Gaussian), there is no need for spreading. Using an extremal inequality of Liu-Viswanath 
p4| , we are able to show that transmission of Gaussian signals along with spreading and masking yields 
higher achievable rates that the largest achievable rate with masking alone. 

The rest of the paper is organized as follows. Section II offers the system model. In this section, 
we introduce the randomized spreading coding and discuss how all user can consistently design their 
spreading/masking sequences. Section III presents the development of achievable rates based on the three 
steps mentioned earlier. System design is brought in section IV where we offer several design examples. 
Finally, section V prove the supremacy of blending spreading and masking over masking alone. Conclusion 
remarks are given in section VI. 

Notation- Throughout the paper, we denote random quantities in bold case such as x and y. A realization 
of X is denoted by x. A circularly symmetric complex Gaussian random vector x of length m with 
zero mean and covariance matrix C is denoted by CA/'(0,C). A Bernoulli random variable x E {0, 1} 
with Fr{x = 1} = a G [0,1] is denoted by Ber(a). For a sequence (o-OlI^i — {o-ir ' ' ; '^m) and a 
set S = {^i,--- ,^m'} C {I,-- - ,m} where < ■ ■ ■ < we define (a/)/eH = (a^i,--- ^^w)- 
use E{.} for the expectation operator, Pr{£^} for the probability of an event £, Is for the indicator 
function of an event S and Pxi-) for the PDF of a random variable x. Also, l{x; y) denotes the mutual 
information between random variables x and y, h{x) the differential entropy of a continuous random 
variable x, H(a;) the entropy of a discrete random variable x, and the binary entropy function is denoted 
by J^{x) = —X \ogx — (1 — a;) log(l — x) for x E [0, 1]. For any x E [0, 1], x denotes 1 — x. The Dirac 

''This reminds us of direct sequence spread spectrum communications. 
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delta function is denoted by 5{.). For integers m,n E N, a m x n matrix in which all elements are or 
1 is shown by Omxn or Imxn respectively. For sets A and B, the set A\B denotes a set with elements 
in A and not in B. The cardinality of a set A is denoted by \A\. For any two vectors of the same size 
X and y, the vector x Q y is the element- wise product of x and y. For two function /(7) and (7(7) of a 
variable 7 > 0, we write / ~ ^ if lim^_^oo = lim^^oo and / < ^ if lim^^oo < lim^^oo 
The notation f ^ g is, defined similarly. 

IL System Model 

We consider a decentralized communication network of n user^ The static and non frequency-selective 
gain of the channel from the i*'* transmitter to the j*^ receiver is shown by hij which is in general a 
complex number. In a decentralized network, there is no communication or cooperation among different 
users. Due to the fact that the network has no fixed infrastructure and there is no central controller to 
manage the network resources among users, resource allocation and rate assignment must be performed 
locally at every transmitter. A main feature of such networks is that the i*'^ user is not already informed 
about the channel gains [hj^i]'^^^ concerning the links connecting different transmitters to the i*'' receiver. 
In fact, every receiver has only access to the interference PDF and the knowledge about the number 
of active users and the channel gains can only be inferred through analyzing this PDF. Also, 

different users are not aware of each other's codebooks. As such, no multiuser detection is possible and 
users treat the interference as noise. 

A. Randomized Signature Codes 

In this part, we introduce a distributed signaling strategy using randomized spreading/masking. For 
positive integers T and K, the codebook of the i^^ user consists of 2^^* codewords where a typical 
codeword {xi^t)'t=i is a sequence of i.i.d. circularly symmetric complex Gaussian random variables 
with zero mean and variance 7. The i*^ user transmits (xi^t)t'=i in T transmission frames where each 
transmission frame consists of K transmission slots. In a typical transmission frame, one of the signals in 
the codeword (xj t)^^ is transmitted. To transmit Xi^t, the i^^ user randomly constructs two independent 
sequences called the spreading and the masking codes. The spreading code is a x 1 vector Si^t over 
an alphabet £/ C Z\{0} where the elements of ^ are i.i.d. with a globally known PMF {pa)aes/- The 

^Users consists of a separate transmitter-receiver pairs. 



masking code is a x 1 vector tUj^t whose elements are independent Ber(e) random variables for some 
e G (0, 1]. Thereafter, the i^^ user transmits Xi^tSi,t © ''^i,t in the t*'^ transmission frame. The vector 

Si,t = Si^t © mi,t (4) 

is called the randomized signature code of the i*'^ user in the t*'* transmission frame. We remark that 
the spreading and masking codes of the i^^ user over different transmission frames are constructed 
independently. The alphabet £/ has the property that for any a E £/, we have —a E £/. The received 
vector at the receiver side of the i^^ user in a typical transmission frame is given b}]^ 

= Phi^iXiSi + ^ (3hj^iXjSj + Zi (5) 

where Zj is a CM^Okxi, Ik) random vector representing the ambient noise at the i^'^ receiver. Also, (3 is 
a normalization factor ensuring the average transmission power per symbol of the i*^ user is 7, i.e., 

f3^E{\\s4l} = l. (6) 

In ([5]), we have made the assumption that all active users in the network are frame- synchronous meaning 
their transmission frames start and end at similar time instants. This is not necessarily a valid assumption 
in a decentralized network, however, this makes the presentation of the subject much easier. It is clear that 
the transmitted signals of each user along its transmission frames are correlated while signals transmitted 
in different transmission frames are independent. Hence, we assume any new active user is capable of 
detecting the correlated segments along the interference plus noise process, and therefore, synchronizing 
itself with former active users in the network. However, in case different users are not frame-synchronous 
and users are not aware of the asynchrony pattern, the communication channel of any user is not ergodic 
anymore and one must perform outage analysis. 

Using joint typicality at the receiver side of the i*^ user, any data rate Ri < Q is achievable where 

The term Sj; y^) indicates that the i*'^ user is also embedding information in the sequence of i.i.d. 
signature codes. In fact, one can assume the codeword of any user consists of two sequences, namely, 

*We omit the frame index for notation simplicity. 



the sequence of Gaussian signals and the sequence of randomized signature codes. Due to the fact that 
the signature code of any user is not known to other users and on the other hand, the signature codes are 
independently changing over different transmission frames, the noise plus interference at the receiver side 
of any user has a mixed Gaussian PDF. This makes l{xi,Si;yj) have no closed expression. Therefore, 
we need to obtain a tight lower bound on this quantity whose computation only needs data that can be 
inferred from the noise plus interference PDF at the receiver side of the i*^ user and be fed back to its 
associated transmitter in order to regulate the transmission rate. Throughout the paper, the interference 
term at the receiver side of the i*^ user is denoted by Wi, i.e., Wi — P^j,i^j^3- ^^"^ ^t^t^ "^i 

Wi = SiEiXi (8) 

where 

"^i - (si • • • Si-i Si+i ■■■ s„) , (9) 

Ei = diag(/ii,j, • • • , hi-i^i, hi+i^i, ■■■ , hn,i) (10) 



and 

X,- 



(xi ■■■ Xi^i Xi+i ■■■ Xj^ ■ (11) 



B. Considerations on the Channel Gains and the Number of Active Users 

In general, we assume that the i*'^ receiver is aware of hi^i which can be done through a training sequence 
sent by the i*'* transmitter. Assuming the channel gains are realizations of i.i.d. random variables with a 
continuous PDF, then the number of Gaussian components in the mixed Gaussian PDF of the interference 
in any transmission slot at the receiver side of the i*'* user is if masking is not performed and 

+ 1^ if masking and spreading are both applied. These levels consist of '^jl^j,ip7 where 
ttj e As such, as far as \^\ > 3, the number of active users can be obtained by finding the number 
of interference power levels. However, if ^ = {—a, a} for some a e N and masking is not performed, 
the interference PDF in any transmission slot is Gaussian (the interference vector on any transmission 
frame is still mixed Gaussian) with power a^7 Ylj^i Therefore, the number of active users can not 

be derived by investigating the interference PDF in one transmission slot. In this case, it can be verified 
that the joint PDF of any two transmission slots in a transmission frame is a mixed Gaussian PDF with 
2""^ Gaussian components. This yields a method to find n in case ^/ has only two elements. 
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By symmetry, characterization of Q demands the knowledge of an arbitrary reordering of the sequence 
{hj^i)j-Li. In this paper, we derive a lower bound Cf*^^ on Cj which is only a function of the magnitude of the 
channel gains. Therefore, we need to obtain an arbitrary reordering of Let (h^'-*, " ' ■> ^n-i) 

be a reordering of {hj^i)j^i based on magnitude, i.e., |h^*^| < Ihg^j < ••• < |hi*li|. We consider the 
following cases: 

Case 1- If \£/\ > 4, let a and b be the two largest elements in =e/ such that a > b. Denoting the 
n — 1 largest interference plus noise power levels on each transmission slot by tti < • • • < 7r„_i, we have 
P'ia'Y:U |hf P + 1 = 7r„_i and ^^a^Y^U |hf P + + 1 = i^n-i-i fori < Z < n - 2. 

These n — 1 linear equations yield (|h^*^|)^^^^. 

Case 2- Let masking be the only ingredient in constructing the signatures, i.e., spreading is not applied. 
Denoting the n — 1 largest interference plus noise power levels on each transmission slot by tti < • • • < 
7r„_i, we have P''iY.%l \^f? + 1 = 7r„_i and ^'tEP' \^f? + 1 = ^^n-i-i for 1 < Z < n - 2. These 
n — 1 linear equations yield (|h^*^|)"^]^. 

Case 3- Let — {—a, a} for some a e IR"*" and masking is performed on top of spreading. Then, we 
can apply the same procedure in case 2. 

Case 4- Let ^ = {—a, a} for some a e IR+ and masking is not applied. The joint PDF of the 
interference plus noise on any two transmission slots inside a transmission frame is a bivariate mixed 
Gaussian PDF in which the Gaussian components have covariance matrices of the form 

f3V Ihf P + 1 c,|h«P \ ^^^^ 

P'la' c,|h»p ^^7"^ |h?l' + V 

where Cj e { — 1, 1} for 1 < j < n — 1. The n — 2 largest elements among the off-diagonal elements of 
these matrices correspond to P'^^a^ Ej=i l*^!*^ P ~ /3^7a^ |h[*^ P for 1 < i < n — 2. These elements together 
with the diagonal element ^^^a^ J^^zl jh^'^p + 1 yield {\hf[)]ll. 

Therefore, we have shown that the i*'' user can find n and a reordering of the sequence 

C. A Global Tool To Design The Randomized Signature Codes 

An important issue in a decentralized network is to propose a globally known utiUty function to be 
optimized by all user without any cooperation. As mentioned earlier, the receivers can infer the number 
of active users in the network and the channel gains by inspecting the interference PDF. We consider a 
scenario where this information is fed back to the transmitters. As mentioned earlier, there is no closed 
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formulation on Cj. However, we are able to develop a lower bound Cf^^ for Cj which is tight enough to 
guarantee 

^(ib) ^ 

lim = lim (13) 

7-5-00 log 7 7-5-00 log 7 

In general, Cf^^ depends on hi = As such, we denote it explicitly by Cf^\hi). Assuming 

(^i,j)j'=i realizations of independent CJ\f{0, 1) random variables (h^ j)"^]^, we propose that the i*'^ user 
selects K, {pa)ae^ and e based on 

{k,{Pa)ae^,i) = e^rg sup E lcf'\hA . (14) 

After selecting K and (pa)ae£/ using ( 14 1, the i*^ user regulates its actual transmission rate at Ri = Cf^^ (hi) 
using the realization of hi = hi. 

III. A Lower Bound I(xj, Si\ yi) 

One can write l{xi, Si, yi) as 

l{Xi, Sf, yi) = l{si; y^) + l{Xi; ^Js,) > 1(0;^; ^Js^). (15) 

The term l(xi;yi\si) is the achievable rate of the i^^ user as if this user knew the randomized signature 
code Si already, i.e., the achievable rate of the i*^ user can be in general larger than the case where the 
signature matrices are already revealed to the receiver side. The extra term I(sj;^j) is bounded from 
above by H(sj) which is not a function of SNR. Therefore, 

l{x.,s,;yi) ^ l{xi;y,\s,) _ ^^^^ 

7^-00 log 7 7^-00 log 7 

As such, we ignore the terrrj^I(sj; and focus on developing a tight lower bound on l{xi; yi\si). 

To develop a lower bound on l{xi; ^Jsi), our major tools are linear processing of the channel output 
based on Singular Value Decomposition of the signature code Sj, a conditional version of Entropy Power 
Inequality and a key upper bound on the differential entropy of a mixed Gaussian random vector. We 
have 

l{xi;yi\si) = ^ Fi{si = s}l{Xi;yi\si = s) (17) 

s€supp{Si)\{OKxl} 

In the following, we find a lower bound on l{xi; ^Jsj = s) for any s E supp(si)\{0/<xi}- 

^It can be verified that l{si;y^) = X]sgsupp(s ) Pi^{^i = s}D {Py -\si (■ (■))■ This enables us to compute I(si ; y^) directly. 
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Step 1- The matrix ss^ has two eigenvalues, namely zero and The eigenvector corresponding 
to ||s||| is s and the the eigenvectors corresponding to zero are K — 1 orthonormal vectors denoted by 
Qi, - ■ ■ , gK-2 and Qk-i which together with the columns of make an orthonormal basis for R^. Let 
us define 

Gii^={9^,l ■■■ 9^,K-i), (18) 



(19) 



and 



.0(^-1) 



Xl , 



(20) 



Writing the SVD of s. 



s — Ui{s)d. 



(21) 



The i^^ receiver constructs the vector U-{s)yi upon reception of y^. We have 



(3hi^iXid + Ul{s) {Wi + Zi) 



(22) 



We define 



A 
= 



I3s^ {wi + Zi) 



J 1 



S 2 



(23) 
(24) 
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and 



K 
2 



U}is)iwi + Zi 



K 

2 
K 



-1 K 



G\{s){wi + Zi). 



-I 2 



We have the following thread of equalities. 



(25) 



I(a^,;a;,|t?,) (26) 

where (a) is by the fact that Xi and i^i are independent, i.e., l{xi] ■j^j) = 0. 
Step 2- In this part, we use the following Lemma without proof. 

— * — * 

Lemma 1 Let 0i and @2 be t x 1 complex random vectors and ©3 be any random quantity (scalar or 
vector) with densities. Also, assume that the conditional densities P^-^\q^{-\-) ^^d. p^^^q^{.\.) exist. If &i 

— * 

and ©2 are conditionally independent given ©3, then 



2ih(©i+02|©3) > 2l^(®ll®3) + 2^''(®2|03)_ 



(27) 



We have 



l{xi]U}i\'&i) = h{u}i\'&i) -h{u}i\xi,'&i) 

= h(uJi|i?i) - h (phi,i\\s\\2Xi + (yPilxj, 



(28) 



On the other hand, we know that = phi^i\\s\\2Xi + (/Jj. Defining ©1 = /3/ii,i||s||2a5i and ©2 = V'i> it is 
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clear that ©i and ©2 are conditionally independent given the collection of random variables ©3 = 
As the conditional densities p©j|©3(.|.) and pq^\(q.^{.\.) exist, by Lemma 1, 



(29) 



where (a) is by the fact that the collection Xi is independent of i^j. Dividing both sides of (29) by 



> log 2 



By (26), (28) and (30), 



Step 3- We start by stating the following Lemma. 

Lemma 2 Let @ be a t x 1 mixed Gaussian random vector with the PDF 

L 



Pe(0) = E 



TT* det f2i 



where qi > for I < I < L and g'/ = 1. Then, 



(30) 



(31) 



(32) 



E * log ((vre)* det fi,) < h(0) < ^ log ((vre)* det ^]/) + H((gOf=i) (33) 
«=i z=i 

Proof: Let us define the random matrix fl E : 1 < ^ < such that Fi{Q = = qi and let 

T be a zero mean Gaussian vector with covariance matrix It. Then, one can easily see that = \/QT 
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in which vf2 is the conventional square root of a positive semi-definite matrix. Using the inequalities 

h(0|ri)<h(e) < h(e,ri) 

= h(e|ri) + H(f2) 

= h(e|f7) + H((g0f=i) (34) 

and noting that h(0|f2) = J2iLi 1i ^^S (('''"^)* det Qi), the result is immediate. ■ 
The vector Wi has a mixed Gaussian distribution where the covariance matrices of its separate Gaussian 
components correspond to different realizations of the matrix /3^7 Xljyi This together with 

Lemma 2 yields 

Hwi + Zi) < h{w, + z,\S,) + H I ^ Ihil'^sjs] j (35) 
where we have used the fact that H ^/3^7 Xlj^j — H l^jA^^j^fj ■ has 

= h (f//(s) {w, + 2,)) - h (gI{s) {w, + £,)) 

< h {wi + Zi\Si) + H 1 ^ \hj,i\'^sjs] J 
-h (gI{s}{w. + z,)) 

< h {wi + Zi\S^) + H j J] \hj,i\^Sjs] ] 

-h(Glis}iwi + z,)\S?j (36) 



where (a) follows by the fact that the matrix Ui{s} is unitary, i.e., log | det{Ui{s}) \ = 0, (6) is by (35) and 
(c) is a direct consequence of Lemma 2. Having Si, the vector Wi + Zi is a complex Gaussian vector. 
Hence, 

h{wi + Zi\Si)=K\ogi7Te)+ Yl Pr{Si = S}\ogdet(^lK + P^lSEiElS^y 

sesupp(Si) 

(37) 



By the same token, 



h (gI{s) {Wi + z,) |5i) ={K-1) log(7re) 



sesupp(Si) 



Using (37) and (38) in (36), 



Hip,\d,) < log(7re) + H I \hi\%^] 
+ Yl ^^i^^ = ^} log (^^ + /3'7^S,Sl5t' 

5esupp(Si) 

J2 Pr{5, = S} logdet (^Ik-i + P'jGlis)SE,ElS^Glis)'^ . 



5esupp(Si) 

Moreover, h[l3hi^i\\s\\2Xi) = log (7re/3^|/;,j,ip||s||27). Hence, h[l3hi^i\\s\\2Xi) -h appearing 
can be bounded from below as 



h{i3KM\2x^) - h [<pA) > log (/5>Mrpii27) - H 5^ i/^i.r^,-4 

- 5^ Pr{5, = S} log det (j^ + (3''^SE,eIS^^ 

56supp(Si) 

+ 5^ Pr{5, = S} logdet + /3^G'l(s)5S,Sl5tG'l(s) 



Sesupp(5,) 



Substituting (40) in (31), 



= s) > log (2-«(S.>^» l'^-l'«^^4)f?,(7; + l) 



where 



n 



det (Ik-1 + /^^G'KslSS.SlStG'Ks) 



56supp(5.) \ det (/^ + (i'jSE^ElSt^ 



Pr{S,=S} 



Finally, we get the following lower bound on ^(^"^'1^'^ denoted by cf^\hi), i.e., 

= ^ E = log (2-^(^^^' p. (7; ^ + 1) 



sesupp(si)\{OA'xi} 
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An important observation is that if the i*'* user sets its transmission rate at Ri — Cf"\hi), then 

li^ ^ ^ Pr{g. ^ csp(5.)} ^44^ 
7^00 log 7 K 

To prove this, we need some preliminary results in linear analysis. 

Definition 2- Let S" be an Euclidean space over R and 'W he a subspace of S". We define 

^ {v -.v ±u,yue'^}. (45) 



Lemma 3 Let S be an Euclidean space over Klf"^^ is a subspace of S, then for each v ^ S, there are 
unique elements e ^ and V2^^^ such that v = V2. 

Definition 3- In the setup of Lemma 4, vi is called the projection of v in ^ and is denoted by proj(v; ^). 
By the same token, V2 = proj(t'; '^-'-). 

Definition 4- Let S" be an Euclidean space over IR and and ^2 be subspaces of S". We define 

proj(^i; ^2) = span{proj(T;; ^2) : e ^i}- (46) 



Lemma 4 Let S he an Euclidean vector space over IR and and ^^2 be subspaces of S. Then, 

dim(^i U ^2) = dim(^i) + dim(proj(^2; ^i^))- (47) 

Lemma 5 Let X be a p x q matrix such that rank(X) = q. Then, for any q x r matrix Y, we have 
rank(Xy) = rank(y). 

Proposition 1 Regulating its transmission rate at Cf (hi), the i*^ user achieves an SNR scaling of 

lim ^^^^ = Pr{g. ^ csp(50} _ ^^^^ 

7->^oo log 7 K 

Proof: Using the fact that for any matrix X, icank(XX^) — rank(X), it is easy to see that for 

any s G supp(si) and S G supp(5i), we have logdet [Ir-i + P^jGl{s)SEiElS^Gl{s)'^ scales like 
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rank(G|5') log 7 and logdet (^Ik + P^^SEiElS^^ scales like rank(S') log 7. This yields 

(-(lb)/? N 

lini ^ y Pr{s. = 4 

7->-oo log 7 ' 

sesupp(si)\{OKxi} 

+ J] Pr{5, = S} Pr{s, = s}rank{Gl{s)S) 

5esupp(5i) 
sesupp(si)\{OKxi} 

J2 Pr{5i = S} Pr{si = s}rank(5) 

Sesupp(Si) 

sesupp(si)\{Oif xi} 

+ Yl ^^i^i = ^} ^^i^i = s}TSink{Gl{s)S) 
Sesupp(Si) 
sesupp(si) 

56supp(Si) 

-E{rank(5,)}Pr{g, ^0^x1} 
Pr{s,^0;,xi} 
+E{rank(Gj(s,)5, 

-E{rank(5i)}Pr{si = Okxi} 
-E{rank(5,)}Pr{si ^Oi^xi} 
= Pr{si^O;^xi} + E|rank(Gj(s050-rank(5,)} (49) 

where (a) is by the fact that Gi(Oxxi) — Ik- We show that 

^{SiT^OKxi} + rank(Gj(Si)5i) = rank {[Si\s,]) (50) 

holds almost surely. 
Let us write 

rank([S'j|sj]) = dim(span(sj) Ucsp(S'i)). (51) 

Using this in Lemma 4, 

rank([S'i|si]) = dim(span(si)) + dim(proj(csp(S'i); (span(sj))"'")) 

= %i7^o^xi} +dini(proj(csp(5i); (span(si))^)). (52) 
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On the other hand, by the definition of Gi{si), 



(span(si))-^ = csp{Gi{si)). 



(53) 



It is easily seen that for any 1 < k < K — 1, the k^^ column of the matrix G|(Sj)sj yields the proper 
linear combination of the columns of Gi{si) which constructs the projection of the k*^ column of Sj into 
the space csp(Gi(sj)), i.e., 



Gi{si)[G\{si)Si\k = proj {[Si]k;csp{Gi{si))) . 



(54) 



Therefore, 



span <^ Gi{si)[Gl{si)si]k 



K-l 



k=l 



proj ^span 
proj(csp(5i); csp(Gi(si))) 



K-l 

Silk ) ;csp(Gj(si)) 



(55) 



However, 



span f |G,(s,)[Gj(s,)5,]fc}^^J = csp(G,(s,)Gj(s,)5, 



By (56) and (55), 



proj(csp(5i);csp(Gi(si))) = csp(Gi(sj)G|(si)5i 



(56) 



(57) 



Using (57) and (53) in (52), 



rank([5i|si]) = 1{^^^0kxi} + dim(csp(Gi(si)Gj(si)5i)) 
= l{«,y^OKxi} + rank(Gi(s,)Gl(si)5,) 



(a) 



%,^Oxxi} +rank(Gj(si)5, 



(58) 



where (a) follows by Lemma 5 as Gi{si) has independent columns. Taking expectation from both sides. 



E{rank([5,|s,])} = Pr{s, ^ O^^xi} + E |rank(Gl(sOS'0} 



(59) 



Using this in (49), 



C 



(lb) 



lim 

7^oo log 7 



E {rank([5'i|sj]) — rank(5'j)} 
Pr{s, ^csp(5,)}. 



(60) 
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This completes the proof. ■ 
Finally, the following Proposition proves that Q and Cf^^ have the SNR scaling. 

Proposition 2 Cf*'-' and Cj have the same SNR scaling. 

Proof: See Appendix A. ■ 
An important consequence of Proposition 1 is the following observation. Since, all the users utilize the 
same algorithm to construct their randomized signature codes, the achievable SMG is 

SMG(n) = ^P^{gi^esp([g.|g3|---|4-i|g.])}_ ^^^^ 

K 

Computing Pr {si ^ csp ([S2IS3I ■ ■ ■ |s„_i|s„])} can be quite a tedious task specially for n > 3. Let the 
underlying alphabet to construct the spreading codes be { — 1, 1}. Here, we examine two particular RSCs 
by computing the achieved SMG(n) through simulations for the cases where masking is applied or ignored. 
In each case, we assume the elements of any randomized spreading code are selected independently and 
uniformly over { — 1, 1}, i.e., pi = p_i = \. In case masking is applied, we set s = \. Taking i^' = n, the 
results are sketched in fig. [T| It is seen that 

1- By increasing n, the achieved SMG(n) approaches unity in both cases. This is the SMG of a frequency 
division scenario where interference is completely avoided. 

2- Masking improves the SMG. 

Example 1- Let us consider an RSC scheme where K = 1, i.e., no spreading is applied. In this case, for 
each I < i < n, the vector Si = Si = Si E {0, 1} is simply a Ber(e) random variable for some e E (0, 1]. 
Hence, 

Pr {si ^ csp ([S2IS3I ■ ■ ■ \Sn-i\Sn])} = Pr {si ^ span( {82,83, ■ ■ ■ , s^-i, 

= ePi {0 ^ span( {s2, S3, • • • ,s„_i,s„})} 

+£:Pr{l ^ span({s2,S3,-- - ,s„_i,s„})} 
= ePrjl ^ span({s2,S3,-- - ,s„_i,s„})} 

eFr{s2 = s., = ... = s.., = s. = 0} 
= e{l-e)"-^ (62) 

where (a) is by the fact that Pr {O ^ span( {s2, S3, ■ ■ ■ ,s„_i,s„})} = and (b) is by the fact that 
1 ^ span( {s2, S3, ■ ■ ■ , Sn-i, s„} ) whenever Sj = for 2 < i < n. Maximizing e(l — e)""^ over e, a 
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/; J Alphabet={-1,1}, With Masking 

/ ; Aiphabet={-1,1}, Without Masi<ing 



5 10 15 20 25 

n (Number of Users) 



Fig. 1. Comparison of tiie aciiieved SMG with/witiiout masking where users construct tlieir spreading codes on { — 1, 1} using a uniform 
PMF pi = p_i = |. It is assumed that K — n. In case masking is applied, we have e = 5. 

Sum Multiplexing Gain of (l — :^)" ^ is achieved. Increasing n, the achieved SMG(ri) drops to ^ < 1. 
Comparing this to the results in fig. [T] spreading the signals (K = n compared to K = 1) can highly 
improve the Sum Multiplexing Gain in the network. □ 

Example 2- Let n = 2 and = { — 1,1}. For i E {1,2}, elements of Sj are i.i.d. random variables 
taking the values 0, 1 and —1 with probabilities e, epi and sp-i respectively. We have 

Pr{si ^ span({s2})} = 1 - Pr{si G span({s2})} 

= 1 - Pr{si = Oxxi} - Pr{si 7^ O^-xi, Si = ±^2} 

= l-£^-Pr{si 7^0xxi,si = S2}-Pr{si 7^0xxi,Si = -S2}. (63) 
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However, 



s'esupp(si)\{OKxi} 
K-1 K-k 



= {e' + e'{pl + p\)f-e'^. (64) 



Similarly, 



Therefore, 



Pr{si 7^ 0^x1, = 52} = + 2s^p,p_,f - £2^. (65) 



SMG(2) = 



2Pr{si ^ span({s2})} 
K 

= |(l - + S^'"" - + ^'(P? + P-i))'' - + 2e'piP-i)'') . (66) 
This expression is maximized at pi = p_i = | uniformly for any e e (0, 1] and K > 1. Thus, 



sup SMG(2) = ^ ^. (67) 

pi,p-i ^ 

This function is maximized at X = 2 and e — 0.756 where an SMG of sup^ ^^ p^ SMG(2) = 0.7091 is 
achieved. We notice that 

1- Although one's intuition expects £ = | is the best choice of the On-Off probability, the optimum 
masking probability is not |. 

2- Compared to the Sum Multiplexing Gain of | achieved in example 1 without spreading, we see that 
spreading in fact increases the achieved SMG. □ 

Remark 1- For any mi x m2 matrix A and a mi x mi diagonal matrix D we have x&-nk{AA'^ D) = 
rank(A). Using this, for any s e supp(sj)\{Oifxi} one can write 

prrank(G|(5)5) / g|(?)S5, \ 

til ^11^^ 5esupp(s, n::f (1 + gf^j 

where we have replaces = r J; and by definition, [X^^Yi^i'^^'^ nonzero eigenvalues of the 
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matrix AA^ . 



For sufficiently large SNR values, one can write Cf^\hi) given in (|43|) as 



Ft{s, i csp(5,)} , P'^^* ^ 0,,xi}H 



log7 - 



+ 



^ Pr{si = s) log 



s6supp(si)\{0A'xi} 



11^12 

E{||^.|li} 



j-jrank{Gt(s)5) [ Gt(?)S5, ^ » 



n 



E{||siiii} 



V 



Pr{S,=S} 



/ 



(69) 



There are three major factors playing role in the formulation of Cf^''(/ij) in the high SNR regime, 
namely, the Multiplexing Gain per user, 

Pr{s, i csp(5i)} 



MG 



K 



(70) 



the Interference Entropy Factor, 



lEF 



K 



(71) 



and the Channel plus Signature Factor 



sesupp(si)\{OKxl} 



JO 



Pr{S,=S} ■ 



E{P.||i} 



p.rank(Gt(s)S) / G|(i-)SH, 



n — 

S'esupp(Si) T-rrank(5) / ^g: 
11«=1 Ellis 



E{||Si|li} 



v 



E{Pdli} 



Pr{S,=5} 



In fact. 



CrHl^vl'^Zr^vf.) ^ MGlog7- lEF + CSF, 



(72) 



(73) 



In general, MG does not depend on the user index. Also, assuming the channel gains are realizations of 
i.i.d. continuous random variables, the entropy H {^ji^i i^^*^ ^ function of i G {1, 2, ■ ■ ■ , n}, 

i.e., lEF does not depend on the user index either. In this case, a simple argument shows that 



H^XJ|/i,,ps,4j = - 1)H (sisl) 



(74) 
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The interplay between MG, lEF and CSFj determines the behavior of the achievable rate. This behavior 
highly depends on the randomized algorithm in constructing the Signature Codes. As we will see in the 
next section, a larger MG is usually achieved at the cost of a larger lEF. It is clear that a larger lEF reduces 
the rate specially in moderate ranges of SNR. However, due to the fact that MG has also increased, the rate 
is lifted up is the high SNR regime . These opposing effects identify a tradeoff between rate in moderate 
SNR and high SNR regime. □ 

IV. System Design 

In this section, we assume the channel gains are realizations of independent CN'{0, 1) random 

variables {hij)lj^i representing Rayleigh fading. In the previous section, we have developed a lower bound 



(75) 



sesupp(si\{OKxi}) 



where 



det{lK-. + P^,GKs)SEMS^Glis)) \ 

^ 7 ' ^^^^ 

det + P'^SS^SlSt) J 



and 



Hi = diag {hi^i, ■■■ , hi-i^i, hi+i^i, ■■■ , hn,i) ■ (77) 
The global design criteria is to choose K, {Pa)aej^ and e based on 

{K,{Pa)ae^,i) = 8.rg sup EjcfH^i)}- (78) 
Example 3- Let us consider a network with n = 2 users. For i e {1, 2}, we define 



i'=l . (79) 




In this case, we have 

1- " — h I 

2- Since Si — Si>, for each t e supp(5i)\{0i<:xi}> we have T8ink{hi> it) — 1 and a[^^ -= l^^i' iPll^li- 

3- For each s e supp(si) and t e supp(5i), we have rank(h.i/,iG|(s)i) < 1. Indeed, Gl{s)t e IR and if 
Gl{s)t^ 0, then A«^^,^^^.= \h,,\'\Gl{s)tr. 



Therefore, ^^(7; s) can be written as 

\h^,^m\h 



mm} 



n 



1+ 



Pr{s,, 



1 + 



tesupp{s,,) \ ^ I E{||s,i|2} 

Scheme A- Let K = 2 and £/ = { — 1, 1} with pi = v and p_i = u for some 



the expression for ^^(7; s) in (80), we make the following observations: 
1- If s has only one nonzero element, then 



2- If s has no zero elements, then 

As such, it is easy to see that 

1- If s has only one nonzero element, then 



t = O2XI or t = ±s 

1 oth. 



t = O2XI or t = ±s 

7T: 



1 

k 2 



2 t's = 0,t^02^i 



2- If sG {(1,1)^, (-1, -in, then 



3- If s G ,(-l,in, then 



\hi,i\h (1 + 



4e 



2e 



4e 



£ 1 + 



2s i 



2ee 



Finally, it is shown in appendix A that 
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Simulation results indicate that cf^\hi) is maximized at z/ = ^. Setting 1^=1, 



ee log 



1 + 



2-2.ir(.)-e2|^ ,2 



7 



1 + ^ 



€ 1 + 



2e 



1 + 



(87) 



It is also evident that 



and 



MGscheme ^ ^ 2 ^ "2 ~ ^ 



lEFschemeA — ^ I .^(^ 



(88) 



(89) 



Scheme B- Assuming no spreading is performed, let K = 1. Noting the fact that supp(s2 
supp(s,0 = {0,1} and = 0, 



e 1 + 



(90) 



It is easily seen that H(sisJ) = J^{e). Therefore, 



cfV^,,)=eW| 1 + 



e 1 + 



MGscheme B — 



(91) 
(92) 



and 



lEF 



scheme B 



(93) 



Fig. |2j sketches sup^ E |cf'^''(hj)| for the schemes A and B. It is seen that there is a tradeoff between 
the rates at medium and high SNR values. Fig. [3] demonstrates the best e chosen by the users. It is seen 
that any user in both schemes starts with £ = 1 at 7 = 5dB. Selecting e = 1 in scheme B leads to 
lEFschemeB = 0. Howcvcr, M G scheme B IS kept at zcro as well. Therefore, by increasing SNR, the average 
achievable rate starts to saturate, and hence, users switch to e = 0.45 for 7 > 20dB to avoid saturation. In 
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scheme A, e is set at 1 for SNR values up to 35dB. The yields lEFschemeA = \ which can be considered 
as a reason for poor performance of scheme A in the range 7 < 15dB compared to scheme B. Since 



MG 



scheme A 



0.25 is larger than MGgchemeA 



£=0.45 



, the average achievable rate per user becomes 



eventually larger in scheme A compared to scheme B as SNR increases. 



7r 



2 - 
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Fig. 2. Comparison between sup^ E |c^''''(/ii)| in schemes A and B for different SNR values. 



Example 4- We consider a decentralized network of n > 2 users. We present the following scenarios: 
The signature sequence of any user consists of an spreading code over the alphabet { — 1, 1} where 
Pi = and p 1 = z7, i.e., masking is not applied. The purpose of this example is to show that in contrast 
to example 3, the optimum value of u is not necessarily ^. 

Before proceeding, let us explain why the common intuition is to set z/ = ^. It is well-known that in 
an additive noise channel with a stationary noise process, as far as the correlation function]^ is fixed, a 
stationary Gaussian noise process yields the least mutual information between the input and output. WE 
call this the Gaussian bounding technique. Using this fact, one can obtain a lower bound on \{xi] yi\si) 
as 

det Cov(yj) 



l{xi-yi\si) > log- . 

det Cov(iUj + Zj) 

*The correlation function of a zero-mean process x[f] is the function E{x[f]x^[t — At]} for At G 



(94) 
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Fig. 3. Comparison between sup^ E | Cf^\hi) > in schemes A and B for different SNR values. 




Fig. 4. 



Comparison between MG in schemes A and B in terms of e. 
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Fig. 5. Comparison between lEF in schemes A and B in terms of e. 



It is easy to see that 

n 

CoY{y,) = Ij, + ^Y, ((1 - (2^^ - + (2^^ - l)'Uxi^) (95) 

and 

Cov(tB, + z,) = Ik + j^Y1 I^^'^I' - - ^Y)Ik + (2z/ - iflKxK) ■ (96) 

Therefore^ 

det Cov(2/J = I 1 + ^ 

and 

det Cov(it>j + 2j) = 1 H — 

V ^ 

'Note that l/c xk = lifxil/txi- Then, one can use the identity det(/mi + AB) — det(/m2 + BA) for any mi x m2 and m2 x mi 
matrices ^ and B. 



\ / (2.^-i)-7e;.jmM ,,,, 



29 



Finally, we come up with the following lower bound on 



> log I 1 + (l-(2,.-iP)7E,^J^...P j ^ 1 I (2'--l)^7E^^J^..P ■ 

It is straightforward to see that this lower bound is maximized at = 1 and = \ for any realization 
of the channel gains. Hence, 



^ log 1 + ^ ^ ^'^--i;^ „ 1 . (100) 

Although, this lower bound suggests to set = 1 and in case K > 1, it requires v = ^, we demonstrate 
that taking a K > 1 and regulating at some ^ \ yield achievable rates larger than the threshold 



Tn = sup E <( log 1 + 



7 



^ ^ ^ r]"-^ log ( 1 + - ) e-^-^fir/. (101) 



In fact, r„ is the maximum average achievable rate by regulating the transmission rate of the i user at 
log ^1 + 1^ p V In (101), we have used the fact that is an exponential random variable 



with parameter 1 and 2 • is a xlin-i) random variable. 

Let n = 4. In this case, T4 = 0.4809. To compute Cf^\hi), we notice that 

1- For any sE supp(s,;), ||si||2 = K. 

2- In appendix B, it is shown that 

K 



H (sisl 



^ (f ) i"'^'^'''' + ^''~'^'^') log (^^'+'^^''^' + . (102) 

k=0 ^ ^ 



In contrast to example 3, computing cf^\hi) in closed form is a tedious task. As such, we calculate 
E |cf^^(^i)| through simulations. Setting the SNR at 7 = 60dB, fig. |6| sketches E |cf''^(/ii)| in terms 
of pi = z/ for different values of K. In spite of one's intuition, the average achievable rate per user has 
a double-hump shape and is not maximized at z/ = |. It is seen that the best performance is obtained at 

= 3 and z/ G {0.09,0.91}. □ 

Remark 2- To gain some insight on why E |cf'^''(^j)| is double-hump in example 4, one can study 



the multiplexing gain per user given in (70). Let us consider a network with n > 4 user^ | where the 



It can be shown that this phenomenon does not hold for n — 2,3. 
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Fig. 6. Comparison between lEF in schemes A and B in terms of e. 



signature codes only consist of spreading over the alphabet = { — 1,1}. In general, one can write 

|s, G csp(5,)} = |s, G col(5,) U col(-5,)} |J {s, e csp(5i)\(col(5i) U col(-5,))}. (103) 
Therefore, 

Pr{si ^ csp(5i)} = l-Pr{siGcol(5i)Ucol(-5,)} 

-Pr{si G csp(5i)\(col(5,) Ucol(-5,))} 
= Pr {si i col(5,) U col(-5i)} - Pr {si G csp(5i)\(col(5i) U col(-5i))} . 

(104) 

The term Pr {sj ^ co\{Si) U col(— Sj)} can be easily calculated as 

Pr {s, i col(5,) U col(-5i)} = ^(A (l - u'^u^-'' - z/V^"^)" ' . (105) 

On the other hand, computation of the term Pr {sj G csp(>S'j)\(col(5'i) U col(— Sj))} is not an easy task. 
However, the point is that both Pr {sj ^ col(5i) U col(-5j)} and Pr {si G csp(5i)\(col(5i) U col(-5j))} 



31 



have a global maximum at z/ = ^. Hence, there is a chance that their difference is maximized at some 
z/ 7^ ^. This is exactly what happens here. As an example, fig. [v] sketches multiplexing gain per user in 
terms of pi in a network with n = 10 users. It is assumed that the spreading code length is = 6. 
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Fig. 7. Sketch of P'"t''i^^^^p('^t)} terms of pi = in a network of n = 10 users witii K = 6. 



Remark 3- The expression for the SMG given in (61 1 does not depend on the spreading/masking strategy. 
In fact, one can consider a more general scheme where the i^^ user randomly selects its code Sj out of a 
globally known set of codes € C IR^\{Oa'xi} based on a globally known PMF. In case n = 2, 

2Pr{si ^ span(s2)} 



SMG(2) 



K 



2 Pr I si and S2 are not parallel in } 



K 



(106) 



Taking K = 2, let us assume that C consists of L vectors in IR^ no two of which are parallel with each 
other. Therefore, 



SMG(2) = 1 



1 

T 



(107) 



Since L can be arbitrarily large, the SMG of a network of two users is equal to 1. In this case, it is easy 
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to see that 

IEF = logL. (108) 

If n > 2, taking a set of arbitrarily large non-parallel vectors in some space is by no means a 
necessarily appropriate collection. Let (t = {ci, ■ ■ ■ , Cx} consist of L vectors in . For each I < I < L 
and 1 < r < L — 1, we denote by coi^r the number of distinct subsets 03 of £ of size r such that 
Ci ^ span(!B). We denote these subsets explicitly by - ,^i^r{(^i,r)- Assuming all users select 

their codes equally likely over £, 

1 ^ 

Pr{si ^ CSP([S2|S3| ■•■ \Sn-l\Sn])} = - ^ Pi {q ^ CSp([s2|s3| ■•• \Sn-l\Sn])} ■ (109) 

1=1 

For each I < I < L, 



Pr {q ^ csp ([S2IS3I ■ • • = 5^ 5Z Pr {Vb G Q3;,,(m), 3j > 2 : Sj = b} . (110) 

It is easy to see tha|^ 



r=l m=l 



(n-l)! 



Pr {Vb G 'Bz,,(m),3j > 2 : = b } = (HI) 

for any 1 < / < L and 1 < m < ui^r- Therefore, 

^ L L-1 

Pr{si ^ csp ([salsal ■ ■ ■ |s„_i|s„,])} = -j-^'^'^i,rPr,n (112) 



Z=l r-=l 

where 



iiH htr=™-l 

Finally, the achieved SMG is 

SMG(n) = ''^'=^^-=^ (114) 
We remark that there is no closed formula for p^.n^ however, one can use the recursion 



r'=l 

"Assuming the 1^', • ■ • , (r — 1)*'' and r**^ elements of ^i,r{m) are chosen by ti, - ■ ■ and users respectively, this can happen 

in J2ti+--+tr=n-i different ways. 

ti,---,t,.>i 
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to compute this quantity. By (114), one can easily see that SMG(n) is maximized if is as large as 
possible for each 1 < I < L and 1 < r < L — 1. We know that ui^r < i^r^) ■ This upper bound is achieved 
if £ consists of L < K independent vectors in R^^ . In this case, 

SMG(n) = ^^^^fiA^- (116) 

It is not hard to see that J2r=i {'^^^)Pr,n = {L — 1)"^^. Hence, 

n I 1 



SMGH = -(1--) . (117) 



To get the largest SMG, one may let L = K yielding 



\ n— 1 



supSMG(n) = 1 - - (118) 

K>i \ nj 

which is the result obtained in example 1 via masking without spreading. 

V. Optimality Results 

We have already seen that applying masking on top of spreading can result in larger achievable rates 
due to increasing the attained multiplexing gain. However, our results so far are based on the achievable 
rate Cf°''(hi) which is only a lower bound on the capacity of the i*'* user. In deriving Qf'\hi), the PDF 
of the transmitted signals is taken to be complex Gaussian which is not necessarily optimal. As such, we 
have no optimality arguments so far. 

In this section, we question the optimality of masking without spreading. In fact, we are interested to 
see if at any SNR level, there is an optimal PDF such that generating the transmitted signals based on 
this PDF makes spreading unnecessary. For this purpose, we define the masking capacity of a user as 
the largest achievable rate by this user assuming all users follow the masking strategy with no spreading 
applied. We also require fairness conditions by which we imply that users generate their signals using 
the same PDF. Fixing e G (0, 1], the masking capacity of the i*^ user is defined by 

^^,(£;7,(M^=i) ^ sup \{x,,m,-y,) (119) 

ail,--- jO^TT.'^i.i.d 
E{|a=i|2}<7 



where 



yi = e ^^hi^iVXiXi + e 2 ^ phj^iXtijXj + Zi (120) 
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in which tUj is the masking coefficient of the i^^ user which is a Ber(£:) random variable and Zi is the 
CA/'(0, 1) ambient noise random variable. The parameter e is designed based on maximizing a globally 
available utility function such as E|cf'^^(^j)| assuming {hij)^.j^i are realizations of i.i.d. random 
variables with a continuous PDF. 

We focus on a decentralized network of ri = 2 users. We call the users as user #1 and user #2. According 
to the results in example 3 (scheme B), the decision rule to regulate e is 

{/ 2-'^(=)|^i iP-Y \ 1 
£log 1 + — 1 ^fj U ^ . (121) 

The main result of the paper is the following. 

Theorem 1 There exist ai G [0, |) and a2 G (^,1] such that for any /?.i,i,/i2,i G C, it is possible to 
achieve rates larger than ^^1(5; 7, /ii^i, /;.2,i) for sufficiently large values of j where i G (Q!i,a2) is 



given in (121 ). 



To prove Theorem 1, we need the following Lemma. 

Lemma 6 Let Zi and Z2 be circularly symmetric complex Gaussian random variables with variances af 
and a 2 respectively and X be independent 0/ (Zi, Z2). Then, the answer to the optimization problem 

sup h(X + Zi) - eh(X + Z2) (122) 

X:E{|X|2}<P 

is a circularly symmetric complex Gaussian X for any P > and any ^ > 1. Also, if a\ < , the same 
conclusion holds for any G R. 



Proof: This is a direct consequence of Theorem 1 in [24 1. ■ 
Our strategy is to find an upper bound on ^^i{e]'y, /ii 1, /i2,i) for arbitrary e G (0, 1] and proposing an 
achievable rate which surpasses this upper bound. 
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A. Upper Bound on {e; 7, hi^i , /i2,i) 

We proceed as follows. We have 

I(cci,mi;t/i) = I(a;i;t/i|mi) +I(mi;t/i) 

< I(a;i;t/i|mi) + H(mi) 

= £l(a;i;£"^/ii,imia;i + /i2,itn2CC2 + Zi\mi = 1) 

+e I{xi; £~^/ii,imia;i + e~^h2,iVX2X2 + Zi\mi = 0) + J^(£) 

= e\{xi] e~^hi^iXi + e''^h2,iXn.2X2 + Zi) + ^{e) 
(&) _i _i 

< el{xi]e ^hi^iXi + e ^h2,im2X2 + Zi\m2) + J^{e) 

= eel{xi]e~^hi^iX2 + Zi) + eH{xi;6'^hi^iXi + e~^h2,iX2 + ^i) + J^{e) 
= ££(^h(£~^/ii,ia;i + Zi) - h(zi)) 

+e^(^h(e"^/ii,ia;i + £:"^/i2_^a;2 + zi) - h(e"5/i2,ia;2 + + J^{e) 
= ££ (^h(£"^/ii,ia;i + zi) - I h(£~^/i2,ia;i + Zi)^ 

+£^h(£~^/ii^ia;i + e~^h2,iX2 + Zi) — ££log(7re) + Jif{e) 
= ££ (^h(a;i + z[) - -_ h(a;i + z'/)^ + £2h(£"^/ii_ia;i + e~^^h2,\X2 + Zi) 

+££log(£->i,in -£Mog(£->2,ir) -££log(7re) + (£) (123) 

where (a) follows by the fact that I(cci; /ii iitiiCCi + /i2,iTH2CC2 + Zi|mi = 0) = 0, (6) is by the fact that 
the mutual information between the input and output of the channel increases if a "genie" provides the 
receiver side of user #1 with m2, (c) follows by the fact that X\ and X2 are identically distributed and the 
fact that h(zi) = log(7re) and finally (d) follows by the fact that for any complex random variable X and 
a e C, we have h(aX) = h(X) + log |ap. Also, we have z[ ~ CAf (o, and z'( ~ CM (o, j^^) 
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in the last equality in (|123|). Denoting the upper bound in (|123|) by UB, 



^^1(5; 7, /ii^i, /i2,i) < sup UB 

E{|a,i|2}<7 



< ee sup (h(a3i + z\) — - \\{xi + z"^ 

£Ci ,a;2~i.i.d ^ ^ 
E{|a3i|2}<7 

sup h(£:"2/ii^ia;i + £^2/^2 + 2i) 

E{|a;i|2}<7 

+eelog(£:~-^|/;.i,ip) - log(£"-^|/i2,in - ee login e). 



(124) 



It is trivial that 



sup h(e 2/i^ -^a;^+e 2/^2 1X2 + Zi) = log (vree ^ + 1/^2,1^) 7 + l) 



a;i,a;2~i-i-d 
E{|a;i|2}<7 



(125) 



which follows by the maximum entropy Lemma pT[ . 

Applying Lemma 1, if | > 1 or \hi^i\ > |/i2,i|, or equivalently, £ > ^ or i| > |/i2,i|, the answer to 
the optimization maxa;i,a;2~i.i.d (h(a;i + z[) — I h.(xi + z'/)) is a complex Gaussian Xi. We note that the 

E{|'33i|2}<7 

power of the optimum Gaussian signal Xi is not necessarily 7. Let the optimum xi be a A/'(0, f ) random 
variable. We distinguish the following cases. 

Case 7- If e > I and 5^ < (I) 5, then v = 0. 
Case 2- If . > i, > (|)^ and 7 > £^ {j^^ 



then V 



2e~l \ h: 



1 



Case 3- li e < \ and ^ > 1, then v 

— 2 /l2,l ' 



Verification of these cases is a straightforward task which is omitted here for the sake of brevity. 
Therefore, as far as e > ^, the term supa,i,a;2~i.i.d (h(a;i + z'^) — | \\{xi + z'/)) saturates by increasing 7. 

E{|'a;i|2}<7 



Using this fact together with ( 124) and ( 125) 



/ii,i,/i2,i,7) ^ ^^log7- 



(126) 



as far as £ > ^. On the other hand, if £ < ^ and ^ > 1, 

— 2 '2 /l2,i 



sup [h(a3i + z\) - - h(a;i + z'[) \ ~ ^— ^ log 7. 

a;2~i.i.d ^ e / e 



(127) 



a;i,a;2 

E{|33l|2}<7 
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Using this together with (|124|) and (|125|), 



^^i(£;/ii,i,/i2,i,7) <^^log7 (128) 

as far as e < ^ and ^ < 1. However, we can remove the condition ^ > 1 by a simple arguement. 
Let us fix /i2,i. It is clear that /i, /i2,i, 7) < /i', /i2,i, 7) for h < /i2,i < h'. Since 



/i', /i2,i, 7) < eelog7, we get /i, /i2,i, 7) < e£log7. Hence, (128) holds for all e < ^ 

regardless of the values of hi i and /i2,i. 
To recap, we have shown that 

{e^ log 7 e > I 
' (129) 
log 7 e < I 

We end this subsection with the following Corollary. 
Corollary 1 Ife<\, 

/i2,i,7) ~ ^^log7- (130) 
Proof: By the results in example 3, M'€x{e\ hi^i, ^^2,1,7) ^ £:elog7 for every e G (0, 1). However, 



by (129), /i2,i, 7) ^ £:£:log7 for ^ ^ I- This concludes the proof. 



B. Achieving Rates Larger Than ^^i{e; hi i, /i2,i,7) 

Applying spreading on top of masking, we show that there is a range of e such that it is possible to 
achieve rates larger than /ii 1, /i2,i, 7) as far as 7 is sufficiently large. To transmit its Gaussian 

signal Xi ~ CJ\f {0,'j), user #i spreads Xi along a 2 x 1 random vector Si consisting of i.i.d. random 
numbers taking values in a finite alphabet with equal probability. Thereafter, this user applies the 
masking process by constructing the 2x1 masking vector rUi consisting of i.i.d. Bernoulli random 
variables taking the values and 1 with probabilities e and e respectively. We assume that Si and rrii are 
known to both ends of user #i. Finally, this user transmits /^ajjUVj Sj in two consecutive transmission 
slots where (3 is to ensure the total transmission power per symbol Xi is 7. Assuming both users are 
synchronous, the following vector is received at the receiver side of user #1 



Vi = /3/ii,ia3itni Si + /3/i2,ia32tn2 S2 + 21 



(131) 
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where zi is a vector of independent CA/^(0, 1) random variables representing the ambient noise samples 
at the receiver side of user #1. The achievable rate for this user is 

2 

By our results in section III, 

I(a3i;^Jsi,mi) ~ Pr jtui 0Si ^ span(m2 0S2)| log 7- (133) 

Hence, 

/2i ~ ^ Pr jtrii 0Si ^ span(tn2 0S2)| log7- (134) 



We are interested in values of e so that /ii i, /;,2,i, 7) < Ri is strictly satisfied. By (129) and 

(134), it is sufficient to show that there is a range for e such that 



^Pr|mi0Si ^ span(m2 S2)| > maxje^, ere}. (135) 

Let = {—1, 1}. In this case the elements of nii 0Si and m2 0^2 are i.i.d. random variables taking 
the values 0, 1 and —1 with probabilities e, | and | respectively. The event trii Si G span(m2 S2) 
occurs if and only if nvi Si = O2XI or nvi Si 7^ O2XI while tui Si = ±m2 32. Then, one can 
easily see that Pr |tni 0Si ^ span(m2 0S2)| = 1 — e"^ — '^i^^Y ~ ^- This can also be deduced from 



p7\. Substituting this in ( 135) requires 



l-e^-2{e6f- — >2msix{e^,66}. (136) 

This simpUfies to Se:^ - Se: + 2 < for e < | and 5e^ - Se^ + lOe - 4 < for £ > ^. Solving these 
inequalities, we get e G (0.3101,0.5653). 

It is not hard to see that e given in ( |121 ) is in the interval (0.4,0.5) for all 7 > 30dB. Setting 



ai = 0.3101 and 02 = 0.5653, we see that i G (ai,a;2) and -Ri is larger than ^'^i(e; /ii^i, /i2,i, 7) for 
large values of 7. This completes the proof of Theorem 1. 

Next, we demonstrate that increasing the size of the underlying alphabet can expand the range of e for 
which achieving a rate larger than ^^i{e; /ii 1, /i2,i)7) is possible. 

Remark 3- If £/ = {—2, —1, 1,2}, the elements of trii Si and m2 32 are i.i.d. random variables 
taking the values 0, —2, —1, 1 and 2 with probabilities e, |, |, | and | respectively. The event tui 0Si G 
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span(m2 82) occurs if and only if tui Si = O2XI or tui Si 7^ O2XI while nii Si = ±m2 S2 
or nil Si = ±2tn2 S2 or tui Si = ±^tn2 S2. We get Pr jtui Si ^ span(m2 S2)| = 



1 — e"^ — 2{ee)'^ — Substituting this in (135) requires 



3p4 

1-6^-2(66? >2max{e^,ee}. (137) 

16 

Hence, 35e^-64e + 16 < for e < | and 35e^ -GAe"^ + 80e-32 < for £ > ^. Solving these inequalities, 
€ e (0.2988,0.5873). □ 

VI. Conclusion 

We proposed an approach towards communication in decentralized wireless networks of separate 
transmitter-receiver pairs. A randomized signaling scheme was introduced in which each user locally 
spreads its Gaussian signal along a randomly generated spreading code comprised of a sequence of 
nonzero elements over a certain alphabet. Along with spreading, each transmitter also masks its output 
independently from transmission to transmission. Using a conditional version of entropy power inequality 
and a key lemma on the differential entropy of mixed Gaussian random vectors, achievable rates were 
developed for the users. Assuming the channel gains are realization of independent continuous random 
variables, each user finds the optimum parameters in constructing the randomized spreading and masking 
sequences by maximizing the average achievable rate per user. It was seen that as the number of users 
increases, the achievable Sum Multiplexing Gain of the network approaches that of a centralized orthogonal 
scheme where multiuser interference is completely avoided. It was observed that in general the elements 
of a spreading code are not equiprobable over the underlying alphabet. This particularly happens if the 
number of active users is greater than three. Finally, using the recently developed extremal inequality 
of Liu-Viswanath, we presented an optimality result showing that transmission of Gaussian signals via 
spreading and masking yields higher achievable rates than the maximum achievable rate attained by 
applying masking only. 

Appendix A 

By Proposition 1, 

lim > P^{^^-^;^P(^--)} . (138) 

7-s>oo log 7 K 
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In this appendix, we prove that 



Um < P^{^^-^;^P(^-)} . (139) 

7->oo log 7 K 



By (16), it suffices to show that Ynn^^oo < Pr {^i ^ csp(>S'j)}. Let us consider the informed i^^ 



user where the receiver is aware of s, and Si. The achievable rate of this virtual user is ^(^"^'1^'''^') . it is 



K 



clear that \{xi] yi\si) < l{xi; y^lsi, Si). However, 

l{xi; y^lsi, Si) = ^ Pr{si = s} Pr{5i = S}l{xi; ^Js^ = s,Si = S) 

sesupp(si) 

Serangc(Si) 

^-^ V Ft\3 -c]Ft\S _ on„ /et(cov(^Jg, = 5,5, = g)) 

Serange(Si) 

^ Pr{s, = s} Pr{5, = 5} logdet (cov {y^\s, = s, S, = S)) 

sesupp(si) 

Serangc(Si) 

- Pr{5i = 5}logdet(cov(iD, + 2i|5, = 5)) (140) 

5erange(Si) 

where (a) follows by the fact that fixing Si = S converts the channel of the i*'* informed user to an 
additive Gaussian channel. On the other hand. 



J2 MS^ = s}Ft{S, = 5} logdet (cov (j^Js, = s,S, = S)) 
sesupp(si) 

Serange(Si) 

J2 Pr{s. = s} Pr{5, = S} logdet (J^ + f3'7\hi,i\^s^ + /3^5S,Sf 5^) . 

sGsupp(si) 
Serange(Si) 

(141) 

Noting that logdet [Ik + /3^7|/ii,ips5^ + 13'^'ySEiEf S'^) scales like rank ([s S]) log 7, we conclude that 



the first term on the right hand side of (140) scales like E{rank([sj 5'j])}log7. By the same token. 



the second term on the right hand side of ( |140[ ) scales like E {rank(5'j)} log7. Therefore, I(£j;^j|sj) is 
upper bounded by a quantity 
the Proposition is immediate. 



upper bounded by a quantity which scales like ^E{rank([sj Si])} — E{rank(5'j)} j log 7. The result of 
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Appendix B 



Let si = (^si^i 51,2) • Therefore, 
H (^s,s\ 



— H (|si_ip, |si^2|^7 'Si, 1*1^2) 

= H (|si,ip, |si,2p) + H (si,iSi,2||Si,i|2, |si,2p) 

= H + H (|si,2n + H (si,lSl,2||Sl,lP, |Sl,2|') 

= H + H (|S1,2|) + H (si,lSi,2||si,i|, |S1,2|) 

= 2^(£)+H(si,iSi,2||si,i|,|si,2|). 

To compute H (si_iSi^2| |si,2|), we have 

H (si,iSi,2||Sl,l|, |Sl,2|) = H (si,iSi,2||Sl,l| = 1*1,2! = 1) Pi'llSl,!! = 1> 1*1,2 



1} 



l«l,ll 


= 0, 


^1,2 


= i)M|si,il 


= 0, 


^1,2 


= 1} 


1*1, ll 


= 1, 


^1,2 


= 0) Pr{|si,i| 


= 1, 


^1,2 


= 0} 


lsl,ll 


= 0, 


^1,2 


= 0) Pr{|si,i| 


= 0, 


Si, 2 


= 0} 



(a) 



(142) 



H (si,isi,2||si,i| = 1, |si,2| = 1) Pr{|si,i| = 1, |si,2| = 1} (143) 



where (a) is by the fact that the terms H (si^iSi^2| |si,i| = 0, |si,2| = l), H (si_iSi_2| = 1, |si^2| = O) 
and H (si 2] |si i| = 0, |si 2| = O) are zero. On the other hand, it is easy to see that Pr{si iSi 2 = 
l| |si,i| = 1, |si,2| = 1} = i^'^+i^'^- This implies H (si^iSi^2| = 1, |si_2| = l) = ^(z^^+I^^). Therefore, 



H (si,isi,2| |si,2|) = + V^) Pr{|si,i| = 1, |Si,2| = 1} = + 



V 



Using (142) and (144), 



(144) 



(145) 
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Appendix B 



Let si = ( si^i • • • si^K ' • We have 



(a) 



XT / N 



(146) 



where (a) is by the fact that = 1 for any 1 < k < K and (6) is by the fact that for any two distinct 
numbers k,l E {2, - ■ ■ , K}, the knowledge about si ^si / can be obtained by knowing si iSi ^ and si,iSi ^ 
by the fact that si iSi ^.Si ^ = si ^s^ ^ = si ^Si i. Let us define 



s, = (si,2 ■ ■ ■ si,^) . (147) 



By (146), H(sis{) = H(si_iSi). Let S be the event where Si i = 1, while k of the elements of Si, 
namely, si,/^, ■ ■ ■ , Si and si j^. are 1 and the rest are —1 for some < k < K and 2 < li < I2 < 
■ ■ ■ < h ^ K . Also, let T be the event where Si^i = —1, si ^ = —1 for / G {/i, l2, - ■ ■ , 4} and si ^ = 1 
for / ^ {/i, ^2, ■ ■ ■ ; 4}- It is clear that 

si,isil^ = si,isil^. (148) 



We know that Pr{^} = u'^+^u^-k Pr{JP} = z/^-'^zJ^+i. Hence, using ([148)), 

H(sisl) = - (^) + z/^-'^I/^+i) log {u'^+'u^-'^ + z/^-'^z/'^+i) . (149) 

fc=0 ^ ^ 
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